.\D-A0b3  986  NORTH  CAROLINA  UNIV  A'*’  CHAPEL  HILL  DEPT  OF  STATISTICS  F/8  9/4 

TOWARD  A Theory  of  probabilistic  automata  with  environments* (U) 

1978  J SOULO*  E J WE8MAN  N00014-67-A-0321-OOO6 


ODC  FILE.GOPJ'  ADA053986 


.\FOSIl-TR-  7 8-  0730 


THEORY  AUTOMATA 

Chairman;  I.  Bratko 

TOWARD  A THEORY  OF  PROBABILISTIC  AUTOMATA  WITH  ENVIRONMENTS 

EDWARD  J.  WEGMAN 
University  of  North  Carolina 
Chapel  Hill,  North  Carolina  (U.S.A.) 


JERREN  GOULD 
Claremont  Graduate  School 
Claremont,  California  (U.S.A.) 


The  viewpoint  is  taken  that  every  probabilis- 
tic automaton  is  situated  within  a sequence  of 
environments  which  affects  the  initial  state 
distribution  and  the  transition  function.  There 
exists  a probabilistic  automaton  within  a deter- 
ministic environment  sequence  (ADE)  which  defines 
an  event  which  is  not  a PCE,  yet  in  certain  non- 
trivial cases  the  behavior  of  an  ADE  can  be 
simulated  by  a probabilistic  automaton.  For 
probabilistic  automata  within  random  environment 
sequences  there  is  a mean  equivalent  canonical 
representation  which  eliminates  the  randomness 
due  to  probabilistic  transition. 
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The  traditional  method  to  describe  a system 
is  to  model  the  behavior  as  it  stands.  The 
system  may  not,  however,  exhibit  identical 
behavior  when  placed  within  a distinct  external 
situation.  That  is,  the  input  and  quintessential 
dynamics  of  the  system  remain  the  same,  but  the 
external  factors  have  changed.  These  external 
factors  are  the  environment  within  which  the 
system  operates.  By  the  traditional  approach  a 
system  which  performs  differently  within  distinct 
environments  would  have  to  be  regarded  as  a 
collection  of  distinct  systems.  Consideration 
of  automata  within  environments  allows  the  various 
factors  which  may  influence  the  behavior  of  the 
system  to  be  Incorporated  in  the  model.  Thus,  by 
this  more  fundamental  description  systems  which 
perform  differently  within  distinct  environments 
could  be  identical  with  the  difference  in  behavior 
being  attributed  to  the  environments.  Automata  in 
media  were  investigated  also  in  and  ClO],  but 
our  concept  is  more  general  and  includes  this 
earlier  work  as  a special  case. 

Many  biological  or  social  systems  operate 
within  environments  which  influence  their  behavior. 
Even  mechanical  or  electrical  systems,  intended 
to  be  independent  of  external  factors,  may  exhibit 
such  behavior.  If  the  environment  may  be  control- 
led or  the  internal  dynamics  modified,  then  there 
*iay  be  methods  of  optimizing  the  behavior  of  the 
system. 

Probabilistic  automata  (PA)  are  mathematical 

models  for  finite  state  systems  which  admit  at 
- • 
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discrete  intervals  certain  inputs  and  emit  certain 
outputs.  If  the  system  is  in  state  s.  and  if  the 
present  input  is  o,  then  the  system  may  go  into 
any  state  and  the  probability  of  going  to  state  s. 
depends  only  on  s.,  s.,  and  o.  The  output  of  the^ 
system  depends  oniy  oA  the  state  obtained.  There 
is  extensive  literature  on  probabilistic  automata. 
In  this  paper  we  shall  follow  the  notations  of 
[7^  and  [5].  In  particular,  the  formulation  given 
therein  amounts  to  assuming  that  the  set  of  out- 
puts contains  just  two  elements.  Because  of  the 
restriction  to  two  outputs,  these  automata  can  be 
viewed  as  defining  (recognizing)  sets  of  sequences 
of  inputs  (tapes);  this  point  of  view  is  adopted 
throughout  this  paper. 

Probabilistic  automata  exhibit  a behavior 
independent  of  environmental  variation.  It  seems 
quite  natural,  however,  to  consider  automata  with 
stochastic  behavior  located  within  environments 
which  affect  their  properties.  Thus,  the  prob- 
abilistic transition  function  of  the  system  is 
not  only  related  to  the  present  state  and  input, 
but  also  to  the  present  configuration  of  the 
environment.  Also,  the  initial  state  distribution 
and  final  output  relation  may  depend  on  their 
repective  environments. 

This  work  surveys  some  lines  of  research  in 
Gould  and  Wegman  and  Gould  CO,  Cz!]-  In 
this  paper  we  develop  a formulation  of  environ- 
ments and  of  probabilistic  automata  within  envi- 
ronments and  answer  some  of  the  basic  questions 
about  them. 

The  sequence  of  environments  may  be  derived 
from  a deterministic  rule;  in  such  a case  we  have 
an  automaton  in  deterministic  environments  (ADE) . 
ADE  are,  in  general,  stronger  than  probabilistic 
automata.  In  an  effort  to  find  when  an  ADE  and 
a PA  have  the  same  capability,  we  introduce  the 
concept  of  simulation  of  an  ADE  by  a PA  (Theorem 
2) . Reduction  of  the  environment  set  to  certain 
finite  structures  is  also  considered. 

Finally,  we  consider  the  case  of  probabilistic 
automata  operating  in  random  environments  (ARE) ; 
we  assume  that  the  realization  of  any  environment 
is  governed  by  some  probabilistic  structure. 

Hence,  the  environment  sequence  is  a stochastic 
process.  We  encounter  the  dual  nature  of  the 
ranaomness  involved  in  ARE.  We  have  that  the 
environments  are  random  and  that  for  each  value 
the  environment  assumes,  the  probabilistic  tran- 
sitions are  defined.  The  relative  frequency  of 
acceptance  of  a tape  under  a fixed  random  environ- 
ment sequence  is  a consistent  estimator  of  the 
expected  acceptance  probability.  Finally,  we 
find  that  there  is  a mean  equivalent  canonical 
representation  which  eliminates  the  randomness 
due  to  probabilistic  state  assignment  and  tran- 
sitions. Thus,  for  any  automaton  in  random  envir- 
onments we  ran  find  a finite  automaton  in  random 
environments  with  finite  environment  set,  deter- 
ministic assignment  of  the  initial  state,  and 
deterministic  transitions  which  has  a state  dis- 
tribution equivalent  in  the  mean  for  any  input 
tape. 


1 . Probabilistic  Automata 

In  this  section  we  present  some  of  the  basic 
definitions  and  results  from  the  theory  of  prob- 
abilistic automata  which  will  be  used  in  the  suc- 
cei'-*ing  sections. 

Let  Z be  the  finite  input  set,  the  alphabet, 
and  let  E*  be  the  class  of  all  finite  sequences  of 
elements  of  E.  Let  us  also  include  A,  the  empty 
tape,  in  E*.  If  x = oi...ok  is  a tape,  then  the 
length  L(x)  of  x is  L(x)=k.  Note  that  L(A)=0.  If 
X and  y are  tapes,  then  xy  will  denote  the  tape 
which  is  the  concatenation  of  x and  y. 

Let  denote  the  set  of  all  n * n stochastic 
matrices  and  denote  the  set  of  all  n-dimension- 
al  stochastic  vectors. 

Definition  1 A probabilistic  automaton  (PA)  over 
the  alphabet  E is  a system  A = (S,M,iio,  F) , where 
S = (si,...,  Sn)  is  a finite  set  (the  set  of 
internal  states),  M is  a function  M:  E -*•  A#n  (the 
matrix  transition  function)  such  that  mij(o)  is 
the  probability  of  changing  to  state  sj  under 
input  0 given  that  the  system  is  in  state  Si> 
iiq(  Pj,  (the  initial  state  distribution),  and  Fc  S 
(the  set  of  acceptance  states). 

The  function  M can  be  extended  to  define  the 
transition  probabilities  for  going  from  state  sj^ 
to  state  Sj  by  a sequence  x(  E*.  Let  M(A)  • I^, 
the  r n identity.  For  x^o\ . . .0^^,  we  obtain 
M(x)  by  the  rule  M(x)  = M(oi)M(02)  . . .M(0|.) 

Let  A » (S,M,itQ,F)  be  a PA  over  alphabet  E. 

We  define  the  state  distribution  of  A after  input 
tape  X as  ii(x)  » 'ioM(x)  . A tape  x€  E*  is  said  to 
be  accepted  by  A if  a state  in  F is  obtained  after 
tape  X is  input.  Let  n*^  be  the  n-dimenslonal 
column  vector  whose  ith  component  is  I if  s^  ( F 
and  0 otherwise.  The  probability  that  tape  x 
is  accepted  by  A is  defined  as  p(x)  and  is  calcu- 
lated p(x)  » it(x)n*^  = iioM(x)n^. 

A PA  may  be  used  to  define  sets  of  tapes. 

These  sets  will  not  only  depend  on  A but  also  on 
an  additional  parameter  called  the  cut-point.  Let 
A be  a PA  and  A be  a real  number,  A fC0,l).  The 
set  of  all  tapes  defined  by  A with  cut-point  A is 
T(A,A)  = {xjxfE*,  A < p(x)}.  Also,  wesayUcE* 
is  a probabilistic  cut-point  event  (PCE)  if 
U » T(A,A)  for  some  PA  A and  some  A f C0,1).  PCE 
is  a synonym  for  stochastic  language. 

2 . Automata  in  Deterministic  Environments 

We  shall  consider  the  aggregate  of  all  config- 
urations of  the  environment  as  an  abstract  set 
denoted  by  E.  Presently,  we  do  not  make  any 
stipulations  as  to  the  origin,  form,  structure, 
or  cardinality  of  £.  As  each  new  symbol  is  input 
to  the  system,  the  configuration  of  the  environ- 
ment attends  to  the  system  and  the  probabilistic 
transition  ensues  as  a function  pf  the  input 
symbol  and  the  configuration  of  the  environment. 

We  also  view  the  initial  state  distribution  as 
a function  of  the  environment. 

Here  we  shall  consider  the  case  in  which  the 
sequence  of  environments  is  specified  by  a deter- 
ministic rule.  That  is,  for  the  initial  distri- 
bution and  the  subsequent  transitions,  we  are 
given  the  precise  condition  of  the  environment. 

Let  £"  denote  the  cartesian  product  of  a countable 
number  of  copies  of  the  environment  set  E.  The 
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environment  sequence  is  a mapping  £(K)  = e^ ( ff 
for  K=0,1,...  We  also  denote  £ by  the  sequence 
(eo,  ei, . . • 

Definition  2 An  automaton  in  deterministic 
environments  (ADE)  is  a system  A = (E.S.C.vo.Fi®) . 
where  I is  the  finite  input  alphabet,  S={Sj,...Sn) 
is  the  finite  internal  state  set,  G is  a mapping 
G:  n X ff  Wjj  (the  basic  matrix  transition 
function),  ng;  E -*  V (the  initial  distri- 
bution function),  F (the  set  of  acceptance 
states),  and  E is  the  set  of  environments. 

The  matrix  transition  function  M is  defined 
on  I*  X ^ by  the  inductive  recursion  rule: 

1.  M(A,e)  = -Ve  € iT 

2.  if  X € E*  such  that  L(x)=K  and  £ ( E“ , 
then  M(xo,e)  = M(x,£)G(o,eg4.i)  . K 

Hence,  for  all  x i ET , K 

M(x,£)  = n G(Oi,  e^), 

i*l 

where  x = oi...a(j  and  £ = (eg,ei,...). 

The  state  distribution  of  A within  environ- 
ment sequence  £ after  input  tape  x is  computed  as 
with  PA  except  the  relevant  quantities  depend  on 
the  environments.  Thus,  we  obtain  iiq(£)  = 
''o(®o)M(x,£)  . Similarly,  p(x,£)  • ii(x,£)ri'^  is 
the  probability  that  A within  environment  sequence 
£ accepts  tape  x.  Clearly,  these  functions  do  not 
depend  on  environments  beyond  the  input  symbols. 

An  ADE  may  also  be  used  to  define  sets  of 
tapes  in  a manner  similar  to  that  of  PA  except 
that  the  set  defined  will  depend  on  the  environ- 
ment sequence. 

Definition  3 Let  A be  an  ADE  and  X be  a real 
number,  X ( L0,l).  The  set  of  tapes  T(A,£,X)  » 

{x|x  € E*,X  < p(x,£))is  called  the  set  of  tapes 
defined  by  A within  environment  sequence  £ with 
cut-point  X. 

We  now  study  the  problem  of  whether  it  suffices 
to  ignore  the  extension  of  ADE  with  the  set  of 
acceptance  states  related  to  the  environment. 
Logically,  we  restrict  the  relationship  to  the 
environment  concurrent  with  the  terminal  input 
symbol  of  any  tape.  Let  us  order  the  2"  subsets  of 
S and  let  ^j(e)  be  the  probability  that  Fj , the 

subset  of  S,  is  the  set  of  acceptance  states 
when  the  environment  concurrent  with  the  terminal 
input  symbol  is  e.  Let  T(A,£,X)  be  any  set  of 
tapes  defined  by  an  extended  ADE  A*(E,S,G,ito,^,ff) 
within  environment  sequence  £ with  cut-point  X and 
with  the  set  of  acceptance  states  related  probabi- 
listically to  the  terminal  environment  by 

Consider  the  ADE  B with  n2"  states  over  the 
same  alphabet,  with  the  same  environment  set,  and 

»0^(eQ)*(*jj(e^)^j(e(,),  ....  voCeoJ^jnCeo)) 

G(o,e)4,(e)  G(a,e)42(e) • • •G(o,e)*2„(ej 

C®(a,c)  • G(o,e)^i(e)  G(o,e)#2(e) ' ‘ -G(o,e)«2n(e) 

G(o,e)*i(e)  G(o,e)42(e) ' ' ■G(o,e)^^„(e) 


» **t>*re  ng  and  G are  defined  in  A. 


It  is  easily  verified  that  for  any  x ( E*  and 
£ < E“  the  probability  that  x is  accepted  by  A 
within  environment  sequence  e is  identical  to  the 
probability  that  x is  accepted  by  B within  environ- 
ment sequence  £.  So  T(A,£,  X)  = T(B,£, X)  for  all 
£ < £“  and  all  X ( C0,1).  But  B is  an  ADE  as  in 
definition  2;  that  is,  B has  a constant  set  of 
acceptance  states.  Hence,  we  have  the  following 
result. 

Theorem  1 Every  set  of  tapes  which  can  be  defined 
by  an  extended  ADE  with  the  set  of  acceptance 
states  related  probabilistically  to  the  terminal 
environment  can  be  defined  by  an  ADE  with  a con- 
stant set  of  acceptance  states. 

Another  possible  extension  is  to  allow  the 
components  of  to  be  arbitrary  numbers  in 

the  interval  [0,1].  However,  for  any  e £ ff, 
is  contained  in  the  convex  hull  of  • • .n  ^ • 

So  n*'^®^can  be  represented  as 

2"  F . 

nF(e)  • j;  ^j(e)n  ^ with 

j-1  ^ 


0 < ♦^Ce)  51  and  E *.(6)  • 1. 

j-1  ■’ 

It  follows  as  a corollary  to  theorem  1 that  the 
class  of  sets  of  tapes  defined  by  these  automata 
is  identical  to  the  class  of  sets  of  tapes  defined 
by  ADE  as  in  definition  2. 

Probabilistic  automata  can  be  considered  as  a 
special  case  of  .ADE  in  two  ways.  First,  for  any 
PA  A » (S,  M,  vg,  F)  over  E we  can  define  an  ADE 
B with  any  nonempty  environment  set  E such  that 
XQCe)  * "0  and  G(<7,e)  * M(o)  Vo  ( E,  Ve  ( E.  Such 
an  ADE  is  not  influenced  by  the  configuration  of 
the  environment.  Hence, ^for  any  X ( [0,1), 

T(A,X)  • T(fl,£,X)  Ve  ( iT  . Also,  for  any  PA  A we 
can  define  an  ADE  wTth  any  nonempty  environment 
set  E such  that  for  some  eg,e  ( E itg(eg)  « ng  and 
G(o,e)  • MCo)¥o  ( E.  For  the  environment  sequence 
e » (eg.e.e,...)  we  obtain  T(A,X)  - T(5,£  X)  for 
every  X ( [0,1).  Thus,  every  set  of  tapes 
definable  by  a PA  can  be  trivially  defined  by  an 
ADE  in  either  of  two  ways. 

Let  E • (o).  Paz  [6]  demonstrated  that  there 
exists  U c E*  which  is  not  a PCE.  Consider  a 
two  state  ADE  A over  alphabet  E,  where 

fl-e  e] 

E • {O.D.  ngCe)  - (l-e,e),  G(o,e)  - eK®'® 

and  * i • elements  of  E*  are  of  the  form 

o*^  for  some  K > 0.  Let  V be  any  subset  of  E*; 
then  V • {o*'i,  0*^2,...}. 

c—  xf  K-Ki  for  some  i .»  . 

For  £(IC)  - othemise 


it  is  clear 


that  V - T(A,£,0).  Since  V is  arbitrary,  every 
subset  of  this  particular  E*  is  definable  by  A 
within  some  environmental  sequence.  But  U c E* 
is  not  definable  by  a PA.  Thus,  the  class  of 
automata  in  deterministic  environments  produces  a 
strictly  larger  class  of  definable  sets. 

3.  Slswilation 

Let  A be  an  ADE  with  finite  environment  set. 
We  shall  construct  an  effective  procedure  to  find 
a PA  which  simulates  the  operation  of  A. 
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Definition  4 A PA  4'  over  alphabet  Z’  simulates 
the  ADE  A = (E,S,G,»oF^K)  if  there  is  a relation  R 
between  I'*  and  E*  » £;  such  that 

1.  for  any  (x,e)  f E*  » fc"  there  exists 
x'  i Z'*  such  that  Cx',  (x,e)J  ( R; 

2.  if  Cx',(x,e)D  ( R,  then  for  each  X(C0,1), 
x'  ( T(A’,X)  iff  x ( TlA.e.X); 

3.  if  for  some  X f L0>1)  *’  f^T(A',X),  then 

there  exists  (x,e)  f E*  « e”  such  that 
Cx',  (x.e)]  « R. 

If  a PA  A'  simulates  the  ADE  A,  given  any  input 
tape  X for  A within  environment  sequence  £,  we 
have  a rule  R to  find  an  input  tape  x'  for  A’  such 
that  x'  has  the  same  acceptance  probability  as  x 
for  A within  some  environment  sequence  e^.  We  say 
a tape  x’  € E'*  is  admissible  if  and  only  if  there 
is  an  input  tape  x for  A within  some  environment 
sequence  £ from  which  the  rule  R will  yield  x'. 

By  condition  3 above  we  see  that  tapes  which  are 
not  admissible  do  not  belong  to  any  set  defined  by 
A':  that  is,  if  x*  is  not  admissible,  then 
p'(x')  = 0. 

For  any  tape  x € E*  with  L(x)  = K J 0 only  the 
environments  eg,ei,...,eK  influence  the  acceptance 
probability.  Hence,  the  relation  R need  only 
depend  on  x and  eo,ei, . . . ,0^. 

We  shall  use  the  notation  *(A)  to  denote  the 
cardinality  of  the  set  A. 

Theorem  2 Let  A » (E,S,C,iio,F,E)  be  an  ADE  such 
that  *'(£;)  < There  exists  a PA  A'  over  some 
finite  alphabet  E'  which  simulates  A. 


M'(o') 


: 0 0 

G(g-^a'))  : • • 

0 • • • • 0 : 0 1 

0 • • • ■ 0 : 0 I 


Let  Xo'  = (0. ... .0,1.0) ,and  f' 

nF 


n>-'  - 


F.  Therefore, 


Suppose  Cx',  (A,e)]  ( R.  Therefore,  x'  ■ 
g(OA,eo)  = g(0,eo}  = eo.  So 

P'(x')  = xq'M'  (eo)n*^  » (xo(eo)  ,0,0)0*" 


’'o(eo)n'^  = p(A,e) . 


Thus,  if  Cx',  (A,£iD  f R,  then  for  each  X € Co,l), 
X'  ( T(A'  ,X)  iff  X ( T(A,e,X)  . 

Suppose  Cx',(x,e)]  ( R,  where  x / A.  Hence, 
L(x)  > 0.  By  definition  of  R we  have  that  x'  « 

g(0x,  (eg ' ol-'-Og  *>**  length 

K > 0.  So  X'  = g(0,eo)^(oi,ei) . . .gCo^,  e^  • 
ego'i. . .o'|.,  where  u 5 oj  S vi(m+l)-l  for  i * 1,..K. 
Thus,  p'(x')  « xo'M'(eoOi'...og')n*^' 

* xg 'M'(eo)M'(ai ' . . .o„')n*^  . But 

f : ? 9l 


K 

M'(oi'...o^')  =1T 
i=  1 


G(g-*(o')) 
6‘ 6‘  ■ 
0 ...  0 
. 0 


0 

0 

1 


Proof:  Let  m = »(E)  and  y = »(E) . Without  any 
loss  of  generality  we  shall  let  I » {1,2,  ...m) 
and  E = (0, 1, . . . ,ij'l)  . Consider  E'*{0,1,..., 
y(mtl)-lj.  Let  Eg  = EufO).  We  now  define  a 
mapping  g:  Eg  x g E'  as  follows: 

g{o,e)  = e * au  Ve  ( E and  Vo  < Eg.  We 
extend  the  definition  of  g to  (Eg  * E)*,  the  set 
of  all  finite  sequences  of  elements  Eg  * E,  by 
component-wise  application  and  concatenation  of  the 
results.  The  extension  of  g is  one-to-one  cor- 
respondence between  (Eg  x E)*  and  E'*.  If  b is  any 
nonempty  element  of  (Egxff)*,  then  b is  isomorphic  to 
(y.  (eo. • • -.eg)),  where  for  some  K>0,  y < Eg*, 

L(y)  = g + 1,  and  eg,...,e|/  ( E.  We  define  the 
relation  R to  be  the  set  of  all  elements  of  the  form: 

Cg(0x,(eg,..  ,e|g)),  (x,e)3 

where  x f E*,  L(x)  « K,  £ » (eg, . . . ,e„,  . . and 
K = 0, 1, .. .Clearly,  for  each  (x,£)  f E* x E there 
exists  a unique  x'  = g(0x,  (eg, . . . , e|g)) , where 
K » L(x),  such  that  Cx',(x,£)J  f R. 

Now  we  shall  construct  a PA  A'  * (S' ,M' ,xg ' ,F') 
over  E'  to  simulate  A.  Let  S'  * Sr{sn+i,  Sp+j*  ■ 
For  any  o'  such  that  0 5 o'  5 y-1  we  define 

.0  1 

M'(o')  X • ? 

xg(l)(0')  • • • Xg(n)(o')'  0 0 

0 • • • 0 .01 

where  xo(**{o')  is  the  ii!l  component  of  xg(o'). 

Note  that  0 s o'  5 (i-l  implies  o'  ( B.  For 
w 5 o'  5 y(m+l)-l,  define 


M(x,^)  : 0 0 

' 0 . . 0 ; 0 1 
0 ..  0 • 0 1 

Hence,  we  obtain  p'(x')  = xg(eg)M(x,e)n*'  * p(x,£). 
So,  in  this  case,  we  have  x'  € T(A',r)  iff 

X i C0,1) . 

We  have  verified  that  Vx  ( E*  ajid  Ve  € £”  if 
Cx',(x,e)]  ( R.  then  for  each  X ( 
x'  ( Tf;5',X)  iff  X ( T(A,£,X). 

Let  x’  ( I'*  be  any  tape  for  A'  such  that 
there  does  not  exist  x ( E*  and  £ ( E“  so  that 
Cx',  (x,£)]  € R.  The  tape  x'  is  not  admissible. 

Yet  x'  = g(b)  for  some  b € (Eg  x £)*. 

A',  the  empty  tape  for  A',  is  the  image  under 
g of  the  empty  tape  in  (Eg  x E)*^,  Clearly,  A'  is 
not  admissible  and  p'(A')  • xg'n*^  = 0.  Hence, 

A'  f T(A',A)  for  any  X f C0,1)  . 

Let  x'  ( E'*  be  any  nonempty  tape  which  is  not 
admissible,  x'  = og'...0|g'  is  the  image  under  g 
of  some  element  b € (Eg  x ff)*,  where  b has  the 
form  (y,  (eg, . . . ,e,g))  and  L(x')  • L(y)  » K ♦ 1. 

Note  that  y f Eg*.  Let  y « TgTi...Tu.  x'  is  not 

admissible  iff  tg  0 or  tj  f E for  some  i«l,...K. 
If  Tg  0,  then  w £ og'  £ y(m+l)-l.  So  A'  enters 
the  absorbing  state  Sn+2  f f at  the  first  transi- 
tion. So  X'  f T(A',X)  for  any  X f C0,1).  If 
Tj  f E for  some  i * 1,...,K,  then  « 0.  Hence, 

0 £ oj'  £ y-1  and  A’  enters  state  Sj|^2  at  the 

(i*l)-th  transition.  Again,  we  have  x'  € T(A',A) 
for  any  X ( CO, 1) . 

Thus,  if  for  some  X € C0,1),  x'  < T(A',X),  then 
x'  is  admissible;  that  is, there  exists  (x,£)  f E**^" 
such  that  Cx',  (x,£)3  f R. 

Consequently,  A',  as  constructed,  simulates  A.  o 
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The  results  of  theorem  2 and  the  previous  sec- 
tion seem  to  offer  a paradox.  We  have  found  a set 
of  tapes  U c defined  by  an  ADE  A with  finite 
environment  set  which  is  not  a PCE.  So  for  any 
X ( CO.l)  there  is  no  PA  Ap  such  that  U = T(i4p,X). 
But  by  theorem  2 there  exists  a PA  A'  over  an*^ 
expanded  alphabet  Z'  such  that  A'  simulates  A. 

Let  U'  » U {g(Ox.e)  | xCT(A,e.X)).  U’  = T(4'.X} 
e«E" 

and,  hence,  is  a PCE.  We  not  only  have  expanded  Z 
to  Z'  but  also  enriched  the  internal  essence  of  the 
system  with  a structure  that  had  been  included  in 
the  environment.  The  problem  for  U E*  remains. 

U ^ U'  and  U'  has  a different  character  within  E'*. 
If  fact,  U as  a subset  of  E'*  is  a set  of  inadmis- 
sible tapes  and  is  not  defined  by  A'.  In  general, 
from  theorem  2 we  obtain  T(A',X)  = I 

X < T(A,£,X}.  Moreover,  for  any  inadmissible  tape 
x'  for  A'  (this  must  include  T(A',X))  we  can  obtain 
a tape  x and  a class  of  environment  sequences  with- 
in which  the  probability  of  acceptance  of  x by  A 
exceeds  X. 

Given  any  arbitrary  n-dimensional  vector  £,  we 
define  jtl  = max  ICjl.  Also,  for  any  n * n matrix 
Q,  we  define  |q|  * max  Iqijl- 

For  any  ADE  A - (E,S,G,ii(,, F.S)  consider  the 
pseudo-metric  d(c,e' ) * max  ( ] ito(e) -no(e')  .max 
|G(o,e)-G(o,e’) I) , where  e,e'  ( E.  The 
environments  e and  e'  have  identical  influences  on 
the  system  iff  d(e,e’)  « 0.  The  environment  set 
is  irreducible  iff  d is  a metric. 

Suppose  E is  reducible  to  a set  ft.  That  is, 
there  is  an  onto  mapping  h;E  ft  c where  if 
h(e)  • et,  then  d(e,et)  • 0.  The  mapping  h is 
unique  only  when  ft  is  irreducible,  h can  be 
extended  to  h:  E“  -►  (ft)“  by  component-wise 
application. 

Corollary  Let  A « (E,S,G,xo,F,f)  be  any  ADE,  then 
T(A,e,X)'  =■  T(A,h(e),X)  for  all  e < ff“  and  X € [0.1). 
Furthermore,  if  »(h(f))  < “,  then  A can  be  simu- 
lated by  a PA. 

Proof:  Since  it  is  clear  that  p(x,e)  « p(x,h(e)) 

Vx  i E*  and  e i f“,  it  must  be  that  T(A,£, X)  = 
T(A,h(e),X)  Tor  any  X ( [0,1).  For  #(h(f))  < - , 
by  theorem  2 there  exists  a PA  A'  which  simulates 
the  ADE  At  * (E.S.G.'no.P.^t) . Thus,  there  exists  a 
relation  Rt  between  E'*  and  (E  * ft)*  satisfying 
definition  4.  Define  the  relation  R between  E'* 
and  (E  x f)*  by  the  rule: 

[x',(x,^!]  « R iff  [x' ,(x,h(e))]  i Rt  . 

It  is  easily  verified  that  R is  the  relation  to 
justify  that  A'  simulates  A.  □ 

Suppose  we  have  an  ADE  A « (E,S,G,iTg ,F,f) , where 
f and  some  binary  operation  form  a semi-group. 

For  each  o f E,  let  the  mapping  G(o,*):  f -*  be 
a homorphism.  Clearly,  for  each  o ( E G(a)  • 
(C{o,£)|e  ( f)  is  a semi -group  with  the  operation 
multiplication.  If  the  semi-group  of  environments 
can  be  generated  by  a finite  set,  then  A may  be 
simulated  by  a PA. 

Theorem  3 Let  A • (E.S.G.xg.F.f)  be  an  ADE  such 
that: 

1.  f • SCf,*),  where  F is  any  finite  set  and 
S(f, •)  denotes  the  semi-group  generated  by 
F and  the  operation 


2,  for  any  o { E the  mapping  GC<j,")  ; f -*  Wj,  is 
a homomorphism; 

3.  xgr*)  is  a constant. 

Then  there  exists  a PA  A'  which  simulates  A, 

Proof : Let  x F E*  and  e^  ■ (eg.ei,...)  < f“. 

Suppose  L(x)  » K.  Each  ej , i«l,...K,  has  a finite 
decomposition  ej  • fj,  <>  ...•^iri  • 

K K ^2 

Thus.  MCx.e)  = TT  GCoj.ej)  = TT  ]T  GCo.f..). 
n X”1  rv  , i'l 

Let  xt  = 01  • • • Ojj  ^ and  let  f be  any 

environment  sequence  with  initial  terms  T.fn,... 
fir, » ^21*— ^Kr,,'  where  f i F is  arbitrary.  Then 

p(x,e)«  p(xt,f).  Hence,  for  all  X i [0,1), 

X i T(A,£,X)  iff  xt  € T(A,£,X).  Clearly,  for  any 
decomposition  of  the  environments  the  corresponding 
derived  input  tape  will  have  identical  acceptance 
properties . 

The  ADE  At  • (E.S.G.itg.F.f)  has  finite  environ- 
ment set  and  so  we  have  a relation  Rt  between  E'* 
and  E*  X whereby  a PA  A ' siroulates^At.  Define 
the  relation  R between  E'*  and  E*  x as  follows: 
[x’.(x,ej]€  R iff  [x'.(xt,f)D  ( Rt 
for  any  decomposition  of  £ and  its  corresponding 
derived  input  tape  xt. 

It  is  easily  verified  that  R is  the  relation  to 
justify  that  A'  simulates  A.  □ 

Continuous -time  probabilistic  automata  as 
introduced  by  Knast  [43  are  seen  to  be  a special 
case  of  the  ADE  if  we  consider  the  time  interval 
for  an  input  to  a continuous-time  PA  to  be  the 
environment  which  attends  to  that  input.  Moreover, 
the  environment  set  E * [O,*)  and  the  operation 
addition  form  a semi -group  and  the  transition 
function  is  a homomorphism  for  each  o f E.  How- 
ever, there  is  no  finite  set  which  generates  [0,“) 
by  the  operation  of  addition.  Knast  showed,  how- 
ever, that  under  certain  conditions  a continuous- 
time PA  can  be  approximated  by  an  ADE  Aj^  « (E,S, 
G,ng,F,Ejj),  where  xg  is  constant  and  * {h,2h,..) 
for  h > 0.  Clearly,  Ej,  * S(h)  by  the  operation 
addition  and  for  any  o ( E and  e F G(o,e)  » 
(G(a,h))®'".  Hence,  the  approximation  may  be 
simulated  by  a PA. 

4 .  Automata  in  Random  Environments 

We  shall  now  assume  that  the  realization  of 
the  environment  is  governed  by  some  probabilistic 
structure.  Hence,  the  sequence  of  environment  con- 
figurations is  a stochastic  process.  This  formu- 
lation is  useful  when  we  are  only  able  to  make 
certain  probeSili Stic  assumptions  about  the  occur- 
rence of  any  environment  configuration  or  when  the 
environment  configuration  can  only  be  measured  by 
statistical  techniques. 

Let  A * (E ,S,G,xg ,F,E)  be  an  ADE.  Let  (n.fl.P) 
be  a probability  space.  For  each  j € (0,1, 
let  ij  be  a measurable  function  from  (D.S)  to 
(E.S'j,  where  S'  is  a o-field  of  subsets  of  E.  The 
family  of  random  variables  Z « (i,|j  ( J)  is  an 
environmental  stochastic  process  lESP)  and  Zj 
denotes  the  random  variable  for  the  configuration 
of  the  environment  attending  to  jit  input  symbol. 
Let  us  assume  that  the  mappings  xg:E-*V„  and  G(o,*): 
E-*MnVa(Z  are  measurable;  hence,  the  compositions 
xo  * *0  “ ”0(^0)  •"‘J  G(o,*)  "Z,  » G(o,Z4)  , j>l  Vo(E,  are 
measurable;  they  are  random''stocha*'tic  vectors  and 
random  stochastic  matrices  respectively. 
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Definition  5 An  automaton  in  random  environments 
Fare)  is  a system  (d.Z),  where  A is  an  ADE  and  Z 
is  an  ESP. 

Define  U -*  eT  by  £(«)  = (ZoC^I  > • • • •)  • 

The  mapping  is  a measurable  map  from  (S1,S)  to 

where  B'”  is  the  smallest  o-field 
generated  by  the  measurable  cylinders.  For  xtl* 
such  that  L(x)  = K we  define  the  random  matrix 
transition  function 

M(a,^Cu)))  ■ J Ij  G(o^ , z^Cu) ) . 

Similarly,  we  have  x(x,£(u)l)  * ’'o(^o(“))M(x,£(u))) 
and  pCx,£(<v)}  = x(x,r(w))n^.  Furthermore, 
T{/1,£,A)  for  any  X €“[0,1)  is  a set  function  of 
u>  € n taking  values  in  the  set  of  all  subsets  E*. 
As  can  be  seen  by  theorem  1 there  is  no  strict 
generalization  in  allowing  the  set  of  acceptance 
states  to  be  related  to  the  terminal  environment. 

Suppose  z^^),  z^^^,...  are  independent  iden- 
tically distributed  (IID)  sequences  of  random 
environments.  fThus,  for  any  fixed,  but  arbitrary 
X € I*,  {p(x,^'^0)"  is  a sequence  of  uniformly 
bounded  IID  random  variables.  By  the  strong  law 
of  large  numbers  we  obtain 

lim  ^ L = E p(x,£)  a.s. 

N-*<»  N i=l 


Definition  6 Let  (A,Z)  be  an  ARE  and  X a real 
number,  x € Lo.l) . The  set  of  tapes  ET(i4,£,X)  » 
{xjx  € I*,  X < E p(x,z)}  is  called  the  expected 
set  of  tapes  defined  by  [A,Z)  with  cut-point  X. 

Let  us  define  the  random  variable  i(i(e)  » 6 on 
the  probability  space  ([0,l],  B[0,l],u),  where 
fi[0,lD  is  the  relative  Borel  field  and  u is  Lebes- 
gue  measure.  For  any  fixed,  but  arbitrary  x€E* 
and  e € we  define  the  random  variable 

rcv  » .Ufin  = 

I(x,e,i(i(6))  otherwise 

I(x,e,i(i)  is  measurable  and  pis]  I(x, £,1)1(6))  • 1}  • 
p(x,e).  Thus,  I(x,e,\)i), which  has  the  same  relevant 
probability  structure  as  an  indicator  that  A within 
environment  sequence  £ is  in  a state  in  F after 
input  X,  has  expectation  E I(x,£,\)i)  » p(x,£).  So 
for  an  ADE  the  relative  frequency  of  acceptance 
estimates  the  acceptance  probability. 

Now  consider  the  composition  mapping  I(x,£,^i) 
defined  on  the  product  space  [0,l]  * D,  where 

ifx 

I(x,£(ii))  ,i|/(6))  Otherwise 

We  now  obtain  E I(x,£,  <i)  with  respect  to  the  pro- 
duct measure  r 

EI(x,£,*)  • 1 l(x,£(w)  ,i|i(0))d(u><P) . 

L0,i3xn 

By  Fubini’s  theorem 

EI(x,£,(|()  * I I .')'(9))<>u(e)dP(u) 

n [0,1] 

* f p(x.£(u))dP(u) 


Ep(x,z), 


where  the  last  expectation  is  taken  with  respect 
to  (n,B,P).  Supposing  {(£{i),  i)if  j^)  indepen- 
dent copies  of  (£,1)1),  then  }f 

is  a seouence  of  random  variables  IID  according  to 
the  product  measure  p * P.  Thus,  the  relative 


frequency  of  acceptance  of  x by  /I  within  IID  en- 
vironment sequences  is  a strong  consistent  unbi- 
ased estimator  of  Ep(x,£).  Furthermore,  when 
there  is  no  additional  information  as  to  the  real- 
izations  of  the  environment  processes,  the  margin- 
al distribution  of  the  frequency  of  acceptance  of 
x based  on  N repetitions  is  a binomial  random 
variable  with  parameters  N and  Ep(x,r).  Accord- 
ingly, we  are  able  to  statistically  decide  whether 
X € ET(/1,£,X)  for  all  X i Ep(x,z). 

Let  [a.Z)  be  an  ARE,  where  J = (E.S,G,xo.F,E) 
and  Z is  a V state  homogeneous  Markov  chain  with 
initial  distribution  a and  transition  matrix  Q. 
Consider  the  PA  B over  I with  nv  states  and 

G(o,l)qu  . . . G(o,v)qiv 
G(a,l)q^j  . . . G(o,v)q^^ 


It  is  left  to  the  reader  to  verify  that  Ep(x,i)  » 
p®(x)  Vx  € E*.  Hence,  if  (A.Z)  is  an  ARE  with  Z 
as  a finite  homogeneous  Markov  chain,  then 
ET(A.£,X)  is  a PCE  for  all  X € [0,1).  In  other 
words,  if  a PA  over  a singleton  alphabet  generates 
the  random  environment  sequence,  then  the  expected 
set  of  tapes  defined  for  any  cut-point  is  a PCE. 
This  generalizes  the  result  of  Turakainen  [9]  that 
if  the  generator  is  a finite  automaton  over  a 
singleton  alphabet,  then  the  set  defined  for  any 
cut-point  is  a PCE. 

If  the  environment  random  variables  within  the 
sequence  are  independent^  we  find 

Ep(x,z)  • (Eiio(zo))  I TTE*'(®i>*i^ 

[i=l 

for  any  x € E*  and  such  a result  defines  an  ADE. 
Furthermore,  if  there  are  only  a finite  nunftier 
of  distinct  distribution  functions  corresponding 
to  the  environmental  random  variables,  then  the 
ADE  can  be  simulated  by  a PA  A'.  In  theparti- 
cular  case  when  £ is  a sequence  of  IID  random 
variables,  we  obtain  T(A ', X)  = ET(A ,£, X)VX€C0,1) . 

5.  A Canonical  Representation  for  Automata  In 

Random  Environments 

In  section  4 we  encountered  the  dual  nature 
of  the  randomness  involved  in  automata  in  random 
environments.  The  environment  sequence  is  random 
and  for  each  value  the  environment  sequence  as- 
sumes, the  probabilistic  state  transitions  are 
defined.  Hence,  the-  state  of  the  system  after 
an  input  tape  within  a random  environment  sequence 
is  a function  defined  on  a product  probability 
space.  We  shall  show  that  for  any  ARE  (A,Z)  there 
is  an  ARE  (Ap,y)  over  the  same  alphabet  whose 
transition  probabilities  are  equivalent  in  the 
mean,  but  the  state  of  (A|;),10  obtained  after  an 
input  within  a random  environment  sequence  is 
only  related  to  the  value  the  random  environment 
sequence  obtains.  The  essence  of  the  machine 
within  Aq  is  deterministic.  To  accomplish  this 
we  need  that  the  initial  distribution  function 
and  the  basic  matrix  transition  take  on  values 
which,  in  addition  to  being  stochastic  vectors  and 


M(o)  » 
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matrices,  respectively,  have  components  that  are 
either  0 or  1.  Thus,  the  only  randomness  in  the 
system  is  the  randomness  of  the  environment 

sequence.  We  shall  also  construct  C^q.I')  to  have  a 
finite  environment  set. 

Let  D(Wjj)  denote  the  subset  of  M such  that  if 
M i "’il“  ® Also,  let  D(l'n)  be 

the  subset  of  I'p  such  that  if  v ( then 

Vi  * 0 or  1. 

Theorem  4 Let  (>1,2)  be  an  ARE,  where  A • (I,S,G, 
i!q,F,E)  is  an  ADE  and  Z = (Zjlj  £ J)  is  an  ESP 
defined  on  (n,S,P)  taking  values  in  E.  There 
exists  an  ARE  (A  ,Y),  where  Ap  = (I,S,H,Po,F,E') 
is  an  ADE  and  Y = (yjlj  ( J)  is  an  ESP  defined  on 
some  (n',S',P')  taking  values  in  E'  such  that 
(A[j,Y)  satisfies  the  following  properties: 

1.  H:  Z X S'  -D(Mn) 

2.  pq:  D'  - D(Pn) 

3.  #(E')  < - 

4.  En(x,£)  = Ep(x,jr)  Yxfl*,  where  i[»(yo.yi,  • •) 

5.  ET(A,^,A)  = ET(A,;k,\)  YX6[0,1). 

Here  we  are  using  n and  o to  denote  the  state 
distributions  of  (A,Z)  and  (A[),Y) , respectively. 
Recall  n = *(S) . Notice  that  knowledge  of  the 
input  X and  the  environment  sequence  deter- 

mines the  state  of  Aq  obtained. 

Proof:  For  any  o € E and  e i E vie  can  decompose 
C(o,e)  into  a convex  linear  combination  of  p=n^-n+l 
elements  of  DCW^) . Thus, 

P 

aio(®3Bi(,(e)  =•  G(o,e) 
i-1 

for  each  oil  and  e i E,  where  B^gCe)  f . 


»ia(e)  > 0 and 
P 


So  for  each  e 6 E we  have  gener- 


ated the  following  arrays  of  numbers  and  matrices: 


(B,  (e).  . .B  (e) 

loi  POl 


Bi,-(e).  . .B  (e) 
m m 


where  m = »(E)  . „For  any  i i , . . . , i„*l , . . . ,p  let 

a (ii,...,i  ) =«  .n  ai  Oj(e).  Now  consider 
“ J-i  J ■'  , 

A(e)  « {ae(ii i J | i i , . . . , i^,  * l,...,p)‘'  as  a 

list  of  numbers.  A list  differs  from  a set  in  that 
redundancy  is  preserved.  Now  for  any  e ( E, 
clearly  ae(ii...,ij:0  and  J ...  E ag(ij, . .i|||)  =1 . 

For  each  ( E,  we  partition  "'aCo)  into  p 
sublists  A,  (e),...,A  (e) , where 

iO|^  pOt/ 

Ai^^(e)  . (aeCii,...,  i^.i,i,i^^j, . . .ij  | ^ 

We  obtain  the  sum  of  the  elements  of  the  list 
*io(*^  f •••i  ^ E...Eae(ij...,i  i, 

'iCM V 

■ “io  f i TT  a.  <5(e) 

* K ‘l  iK-1  ^K*l  ^ra  j)<K  ‘j 


These  are  p”  eles  nts  in  the  list  A(e).  We  now 
construct  the  list  A'(e)  « {a* j(e) | i*l , . . ,p™} 


For  i = 1 +,f^(ij-l)p->'*,set  a'jCe)  * a^Ci  j , . . ,im)- 

This  uniquely  describes  each  element  of  A'(e)  and 
A'(e)  = A(e) . For  each  og  ( E,  we  partition  A'(e) 
into  p sublists  A' ij,  (e) , . . . ,A’  ^ (e)  , where 
a'i(e)  f A'jo,,(e)  iff  aeCij,.  . .,iK.i,j.ig+i. 
•••.im)  £ 

i = 1 + (j-l)p’^'*  + (ij.-l)p*""^.  Actually, 

A'j(j|j(e)  = AjO|^(e) . Thus,  we  have  reordered  A(e) 

and  maintained  the  properties  of  the  partitioning. 

We  now  construct  the  list  B'(e)  * {Bjp(e)  | 
a£E,i=l , . . . ,pO)L  by  the  rule: 

1.  Set  i=l  and  K=1 

2.  a'i(e)  must  belong  to  one  of  the  sublists 

A log(®)  » • • • f A*pQj^(e)  , say  Set 

B'i(jg(e)  = 

3.  Delete  one  occurrence  of  a'.:(e)  from  the 
list  A'jg|.(e),  but  let  the  amended  list 
retain  the  name  A'j(,|.{e)  . 

4.  Increase  the  value  of  i by  1. 

5.  If  i 5 p'",  go  to  step  2.  If  not,  go  to 
step  6. 

6.  If  K < m,  then  set  i=l,  increase  the  value 
of  K by  1,  and  go  to  step  2.  If  not,  stop. 

This  algorithm  must  necessarily  terminate  in 
mp™  iterations  with  the  sublists^ empty . 

We  obtain  for  each  e € E.  p"' 

1.  a'^(e)>0.  Vi=l p"',  a'j(e)xl 

2.  For  each  o £ E , A'{e)  can  be  partitioned 

into  p sublists  A'  (e),...,A'  (e)  such 

that  I a'(e)=a  (el.  P® 

3.  B'.  (e)fD(W  ) Vi  =l,...,p  V(,£  Z and 

B. ^Te)«B4„(e)  i is  an  index  of  an  ele- 


3.  B'.  (e)fD(W  ) Vi  =l,...,p"  Va£  E 

B.  Xe)*B4_(e)  i is  an  index  of  a 
miiit  in  'A',  (e) . 

Also  for  any  of  £ and  e f E. 

y a',  (e)B'  (e)  4.  J J B 


l(e)B'i^(e)  X 


.1,  I Bjoa-i(e) 

I-l  a'i(e)£A'.g(e) 

I B.  (e)  I a-i(e) 


a'.£A'.  (e) 
1 jo' 


.(e)o4„(e)-G(o,e). 


Hence  for  each  e £ E we  have  the  following 
arrangement : 

a-i(el  B'j„^(e)  . • • B'^^Je) 


»’  m(®)  8*  ma • • • 8'  m 

P P ®1  P Om 

Since  D^  *D(W  )x---xD(  ^),  the  Cartesian 
product  of  DCW’^  witR  itself  m"times,  is  a finite 
set  with  n™  distinct  elements,  we  can  order  it  in 
a systematic  way.  Let  Dj^  be  the  k^*'  element  of 
^n  n ordering.  For  each  e £ E and  K«l,..., 

n"*  define  I^(e)  • (i  1 (B'.^  (e),...,B.^  (e))-D^). 
Note  that  Ij(e),...,I  is  a partitiSn  of  the 

set  {1,2, . . . ,p''') . Thus,  we  set 

[ I a'  (e)  if  I.  (e)  * 0 

t i jvY  e A ^ 


^ [ 0 if 
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Hence,  ft|.(e)50  for  K*l , . . . and  for  all  e € ff. 

Also,  fo?  each  e ( 

^nm  nm 

n 


I S,(e) 


K*1 

^nm 


nm  m 

l l a^(e)  " I a>. 
K=»l  i(I„(e)  i*l 


(e)  » 1 and 


K=»l  i(I|,(e) 

rm 
n 


.J,  '‘■io 

K*1  K«1  iflj^(e)  1 m 


p“ 

* Z a’jfeXB’io  (eh....BV„  (e)) 
i>l  1 n 

» (C(o  e) G(o  e)). 

1 ni 

Now  we  are  ready  to  define  (Aj^.Y).  Retain 
i,  S,  and  F from  (/t.Z).  Let  £"  « {1. . . . ,n""}. 
Define  H(o.,K)  to  be  the  matrix  in  Dj^.  For 
K=1 , . . . ,n, ^let  p (k)  be  an  n-dimensional  row  vec- 
tor of  all  zeroe?  except  for  a 1 in  the 
component.  For  n+lSKfn""’  let  Pq(K)  be  any  arbi- 
trary element  of 

Define  yijCe)  '* 

to  for  K=n+1 n™, 

where  x^*^^(e)  is  the  k^*'  component  of  w (e) . By 
Kolmogorov's  Existence  Theorem  we  defin?  the 
process  Y = (y.  ) j f J)  by  the  finite  dimensional 
distributions  ^ 

Ply.  =K  ...,y  =K  ).f  0 (z  )...B  (z  )dP. 

)l  1 Jr  » Jjj  f-i  Jj  ^r  Jr 


where  € J are  all  distinct.  If  same 

j^=0,  replace  (zj  ) by  (Zg)- 

Let  x € Z*  ^e  aA  input  tape  of  arbitrary 
length,  say  x * f 2 i=l,...,r. 


As  a special  case  we  see  that  a PA  can  be 
viewed  as  a finite  automaton  subject  to  the  in- 
fluences of  an  IID  random  environment  sequence. 
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)^YK^(z^)6,^(Zj)...6^^(z^)dP 

^0  “r  Y,(z„)0  (z,)...0,(z^)dP 

o 1 r 

a'^o  ° ■'i  J 

* I technical  rc-.i  , ® 

fl  approved  for  putl'  '^  rovlere 


- I n(x,z)dP  • En(x,^ 

Cl 

where  all  sums  are  from  1 to  n™. 

Clearly,  it  follows  that  ET(Fl,Z,X)=ET(A_,y,i) 
VX  ( [0,1)  a “ 


-F-A-uvea  for  ‘ 
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